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I 

Abstract. An expression is given for the plethysm p2 o Sq, where p2 is the 

power sum of degree two and Sq is the Schur function indexed by a rectangular 

partition. The formula can be well understood from the viewpoint of the basic 

(2) 

representation of the affine Lie algebra of type A 2 



1. Introduction 

The aim of this paper is to prove a formula concerning Schur functions indexed 
by rectangular Young diagrams. More precisely we will give an expression of the 
plethysm p2 ° Sb(n,m) where P2 is the power sum of degree two and Sjj( n ,m) is the 
Schur function indexed by the rectangular partition (m n ) (Theorem |3.1| ). In fact 
the formula is a version of one given in Q). Our main contribution in this paper 
is to understand their formula from the viewpoint of representations of afhne Lie 
algebras. By looking at the homogeneous realization of the basic representation of 

(2) 

the affine Lie algebra of type A 2 , we can shed another light to that formula. Our 
point of view relies on the isomorphism between the principal and homogeneous 
realizations of the basic representation, which was first obtained by Leidwanger j^] . 
As a merit of our understanding, it becomes clear that the formula gives an explicit 
expression of a homogeneous polynomial r-function of a hierarchy of nonlinear 
differential equations. A similar formula for the affine Lie algebra of type is 
already given in || . 

The paper is organized as follows. In Section ^| we fix some notations concerning 
the symmetric functions. Section |^ is devoted to a brief review of division calculus 
of partitions, namely, cores and quotients and their bar analogues. In Section |^ we 
give a simple combinatorial proof of a formula which is presented in j{| . Cores and 
quotients of partitions are required in proving, while in 0] the vertex operators are 
used in the proof. In Section |5| we discuss the basic representation of the affine Lie 
algebra of type . The main result is given in Section ^. 

2. Symmetric Functions 

We denote by P n the set of all partitions of n, SP n the set of all strict partitions 
of n and OP n the set of those partitions of n whose parts are odd numbers. Let 
Xp be the irreducible character of the symmetric group S n , indexed by A € P n and 
evaluated at the conjugacy class p, and be the irreducible negative character of 
the double cover S n (cf. indexed by A € SP n and evaluated at the conjugacy 
class p. Here we recall symmetric functions of variables x — (x±, x<i, • • •) which are 
discussed in this paper. Let p r (x) — Yl%>i x i ^ e the power sum symmetric function 



Classification number :05E05,17B65. 



2 



HIROSHI MIZUKAWA AND HIRO-FUMI YAMADA 



for r > 1. The Schur functions are defined as follows: 

peP„ 

For A £ SP n define Schur 's Q-function and P- function by 

Q x (x)= 2^+ l ^+^z;^p p (x), 
peOP n 

P x (x) = 2- l ^Q x (x), 

where 

JO if n — 1(A) is even, 
^ \l if n- l(X) is odd. 

Let x = (xx, x%, ■ • •) and y = (yi, 7/2, ■ ■ ■ ) be variables. We write 

X = i X l> x 2i ' ' ' )) 

xy = {x l y j \i >l,j> 1). 

When y is specialized as y = (1, oj, cu 2 , • • • , u r ~ 1 , 0, 0, • • • ) for w = exp(27ry'— 
we write 

xu r = xy. 

For a symmetric function F(x), the plethysm p r o F(x) with the r-th power sum 
p r is by definition jn], pl35] 

Pr oF(x) =F(x r ). 

3. Division Calculus of Partitions 

Let r (r > 2) be an integer. For a partition A = (Ai,--- ,A m ), m is al- 
ways supposed to be a multiple of r. Put S m = (m — l,m— 2,... ,1,0) and 
f = (£1, . . . , £ m ) = A + <5 m . We set, for = 0, 1, • • • ,r - 1, 

M fc = {^— — |<e« = fc(mod r)} 
r 

and 

£ W = K?\ • • • C W € M k , (1 < i < m fc ), ^ > . . . > 

We write 

A[fc] = 

Definition 3.1. The collection 

A^ 3 ) = (A[0],A[l],...,A[r-l]) 

is called the r-quotient of the partition A. 

For the strict partition £ = X + 5 m we put a set of beads on the assigned positions 
as follows: 



® 1 ... (ED 

r ( T+T) ... 2r - 1 
2r fi^T) ... 3r - 1 



This figure represents £ = (• • • , 2r — 1, r + 1, r — 1, 0). This beads configuration 
is called the r-abacus of A. A position is called a hole if it is not occupied by 
a bead. Next we set Ck = {rs + k\0 < s < mk — 1} and C = Ufe=o^ fc - Let 
I = (fx, 6, • • • ! fm) be defined by & G C, fi > £2 > . . . > f m . We write 

a cM = e-<5 m . 
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Definition 3.2. The partition A c(V ) is called the r-core of the partition A. 

Example 3.3. We compute the 3-core and the 3-quotient of A = (7, 7, 4, 4, 1). We 
see that 



Therefore 
And we have 

Therefore 



£ = (12,11,7,6,2,0), and 

Mo - {4,2,0}, Mi = {2}, M 2 = {3,0}. 

A[0] = (2,1,0), A[l] = (2), A[2] = (2,0). 

Co = {6,3,0}, Ci={l}, C 2 = {5,2}, 
|= (6,5,3,2,1,0). 

A C < 2 > = (1,1). 



Next we explain the r-sign through the example above. Number the beads in 
the following two ways. 

(1) The natural numbering according to the increasing order. 

(2) The 3-numbering according to the layers. 

natural numbering 3-numbering 

®! 1 ©2 ®1 1 ©3 

3 4 5 3 4 5 

©3 ©4 8 ©4 ©2 8 

9 10 @ 5 — > 9 10 @ 5 
© 6 13 14 © 6 13 14 

When we compare the natural numbering with the 3-numbering we get a permuta- 
tion 

'1 2 3 4 5 6 



CT3(A) ~ 1 1 3 4 2 5 6 
The 3-sign of A, which is denoted by <5 3 (A), is defined to be the sign of 173(A): 

<S 3 (A) = sgno- 3 (A) = -1. 
We now proceed to be the division calculus of strict partitions. Though the 



following arguments are valid for any positive odd integer r (cf |12, |T^|), we need 
in this paper only the case of r = 3. 

Definition 3.4. Let A = (Ai,- •• ,Aj) be a strict partition. We define the double 
of A by 

D(A) = (Ai,--- ,Aj I Ai ,A,-1), 
in the Frobenius notation. 

X X X X 

Example 3.5. Take A = (4, 2, 1) = x x . The double of A is 

x 

o X X X X 

D(A) = (5,4,4,1)= ° ° X X 

v ' v ' ' ' ' 00 ox 
o 

There is a remarkable property of D(X) as follows. 
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Proposition 3.6. (j[o|) Let X be a strict partition. 

(1) There exist strict partitions A bc ( 3 ) and X b [0) such that 

D(A bc(3) ) = D(A) c(3) , 
D(X b [0}) = D(X){0}. 

(2) D(A)[2] is the partition conjugate to D(X)[1]. 

Definition 3.7. (1) The strict partition X bc ^ is called the 3-bar core of A. 
(2) The collection 

X bq(3) = ^ h [Q],\ b [l]) 
is called the 3-bar quotient of A. 

Example 3.8. We compute the 3-bar quotient of A = (11,9,8,7,6,4,2). Adding 
O's in the tail of O(A), if necessary, we always assume that the size of the vector 
O(A) is the multiple of 3. We see that 

D(X) + Su = (23, 21, 20, 19, 18, 16, 14, 11, 9, 7, 2, 0), 

where S12 — (11, 10, 9, 8, 7, 6, 5, 4, 3, 2, 1, 0). To compute the 3-quotient of D(X), we 
put a set of beads on the positions assigned by D(X) + 612 as follows. 

® 1 © 

3 4 5 

6 © 8 

© 10 © 

12 13 © 

15 © 17 

© © @ 
© 22 © 



((4, 4, 2), (4, 4, 2), (3, 3, 2, 2)). 



Read each runner from the bottom and count the number of holes above each bead. 
Thus we have the corresponding partition D(A)[i] (i = 0, 1, 2). In this case the 3- 
quotient of D(X) reads ((4, 4, 2), (4, 4, 2), (3, 3, 2, 2)). This gives the 3-bar quotient 
of A; 

A 6<?(3) = (( 3j2 ),(4,4,2)). 
Moving each bead upwards in the runner successively as far as possible, we get 

© © © 

© © © 

© © © 

© 10 © -(3,1)= .0(2). 

12 13 © 



Thus we see that L>(A) C ( 3 ) = (3, 1) and A bc ( 5 ) = (2). 

A standard exposition of 3-bar cores and quotients is as follows ([^5)). We record 
the given strict partition A directly: 

1 © 

3 © 5 
© © © 
© 10 © 
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for A = (11, 9, 8, 7, 6, 4, 2). This bead configuration is called the 3-bar abacus of A. 
One obtains the 3-bar quotient of A by the following game. 

(1) The parts of the strict partition A b [0] are nothing but the levels of the beads 
in the 0-th runner. 



3 

© -> A b [0] = (3,2). 



(2) Make a sequence consisting of and 1 by the following (a)-(c). 

(a) Read the first runner from the top downwards attaching 1 at the position 
with a bead, and at the position without a bead. 

(b) Read the second runner from the bottom (infinite away) upwards at- 
taching at the position with a bead, and 1 at the position without a 
bead. 

(c) Make a two-sided infinite sequence by concatenating two sequences ob- 
tained the above procedures (a) and (b); (a) to the right and (b) to the 
left. 

lo ©o 
©i 5i 
©i ®o 

10o ©o ^ 10010|0110^ A b [l] = (4,4,2). 
13 14i 

Here 1 = • • • 111 and = 000 • • • . 

(3) Count the number of 0's left to each 1, and we have the partition A b [l]. 
The 3-bar core of A is given directly by removing beads according to the following 
rule. 

(1) Remove all beads from 0-th runner. 

(2) Remove the beads pairwise from the first and the second runners simultane- 
ously. 

(3) Move the remaining beads upwards in the runner successively as far as pos- 
sible. 

The resulting bead configuration gives A bc ' 3 ^. 

1 © 

3 4 5 

6 7 8 ^ ybc(3) _ i<2) 

9 10 11 



To define the 3-bar sign 8z{\) of the strict partition A, we draw the 3-bar abacus 
of A. Number the beads in the following two ways. 

(1) The natural numbering according to the increasing order. 

(2) The 3-bar numbering according to the layers. 

(a) Number the beads on the 0-th runner increasing order. 

(b) Number the beads on the first and the second runners according to the 
increasing order of layers. For each pair, number the bead on the second 
runner before that on the first runner. 
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(c) Number the rest of the beads in increasing order. 
If we take A = (11, 9, 8, 7, 6, 4, 2) as before, then the two numbering are as follows 
natural numbering 3-bar numbering 




3 

©3 
®6 



1 

©2 
©4 

10 



©1 

5 

©5 
©7 



1 

3 ©4 
©1 ©6 



©2 



10 



V^5 
©7 



Compare the two numbcrings, we get a permutation 

1 2 3 4 5 6 
3 4 1 6 5 2 



ff 3 (A) 



The 3-bar sign of A is defined to be the sign of 173(A): 

<5 3 (A) = sgna 3 (A) = -1. 



(i) 



4. Rectangular Schur Functions and A\ 

In this section we give a simple combinatorial derivation of a formula which is 
presented in || in connection with the basic representation of affine Lie algebra of 

type A^K Here the Schur functions are described in terms of the so called Sato 
variables: Uj — Pj/j(j > 1). We will denote them by S\(u). For a given partition 
we draw the Young diagram and fill each cell with or 1 in such a way that (i, j)-cell 
is numbered with (resp. 1) iii+j is even (resp. odd). 

Let £ be a positive odd integer and = (£, £ — 1, • • • , 1, 0) be the staircase 
partition of length I. The partitions Ag (£ >1, odd) are characterized as that they 
are 2-cores such that [T] can be added in each row. Let JF™(A£) (0 < m < £) be 
the set of partitions which are obtained by adding to |T"| 's to A?. It is obvious that 

\m^)\ = ("t!)- 

Theorem 4.1. (5) Let £ be a positive odd integer. Then 

^2 = (- 1 ) lM[lll 5' AI [o](w)5' t Al [i] = s n(t+i-m,m)( u ~ v ) 

for0<m<£. 

Before proving this theorem, we give a definition. A pair of partitions (a, (3) 
is said to be complementary relative to the rectangle D(n, m) if a is contained in 
□ (n, to) and the rest $ = 0(n, m) — a is the 180°-rotation of j3: 




Note that the number of such pairs is equal to ( n ~^ n ) ■ By the well-known rule for 
computing the Littlewood-Richardson coefficients, it is easily seen that 



(1) £<?' m) = 
Proof of Theorem U 



1 if a and (3 are complementary relative to □(n, m), 
otherwise. 



It is well known @ p72, (5.9)] that 
.S' A (« -v)=Y, {-l) m LR x aJj S a {u)S tfs {v), 
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for any partition A. By the above remark we have 

Su(£+l-m,m){ u ~ v ) = (- 1 )' /3 ' 5 'c e ( M ) 5 ' t /3( u )' 

where the summation runs over all pairs (a, (3) of partitions complementary relative 
to the rectangle 0(1 + 1 — m, m). On the other hand, by looking at the 2-abacus of 
/j G ^^(Af ), we see that /x[0] and t /J,[l] are complementary relative to the rectangle 
□ (£ + 1 — to, to). 

□ 



Theorem 4.1 could be understood as an expression of the weight vectors which 



are obtained by acting the group SL-2 to a maximal weight vector in the basic 
representation of A^\ In this respect the formula gives an explicit description 
of a homogeneous polynomial r-function of the nonlinear Schrodinger hierarchy, 
and a Virasoro singular vector as well. The reader is referred to || for the details, 
where the formula is proved by using the vertex operators. These two proofs can be 
transformed to each other via the isomorphism, given by Leidwanger [^) , between 
the principal and homogeneous realizations of the basic representation of . 

(2) 

5. Basic Representation of A 2 ' 

We discuss in this section the basic representation of the affine Lie algebra of 
type A 2 following |(| JjJ. Here the Schur functions, Schur's P and Q-functions 
are described in terms of the so called Sato variables: Uj = pj/j (j > 1) for S\, 
Sj = 2pj/j (j > 1, odd) or tj = 2pj/j (j > 1, odd,) for P\ and Q\. We will denote 
them by S\(u), P\(s), Q\(t), etc. Put T = C[tj\ j > 1, odd], whose basis is chosen 
as {Pa; A 6 SP ni netf}. Associated with the Cartan matrix 



( a u)ije{o,i} 



2 -4 
-1 2 



(2) 

the Lie algebra q of type A 2 is generated by e^, fi, a/(i = 0, 1) and d subject to 
the relations 

[o^i, ot)] = 0, K v , e^] = atjej, [a(,fj] = -atjfj, 
fe, fi] = ki^i, (ade,) 1 -"- ^ = md/,: ; ./' =0 [i ^ j), 

and 

[d, a/] = 0, [d, ej] = ^,oej, [d, fj] = S j>0 fj. 

The Cartan subalgebra t) of g is spanned by OQ,a\ and d. Choose the basis 
{ao, ai, Ao} for the dual space f)* of () by the pairing 

< ,a>i > = a,ij, <aY,Ao>=6i l o, 

< d, ctj > — Soj, < d, A >= 0. 

The fundamental imaginary root is 5 = 2uq + u\. 



The basic representation of g is by definition the irreducible highest weight g- 
module with highest weight Ao. The weight system of the basic representation is 
well known: 

P(A ) = {A - pS + qai ; p>2q 2 , p,qe^Z, p + q£ Z}. 

A weight A on the parabola Ao — 2q 2 S + qai is said to be maximal in the sense 
that A + 5 is no longer a weight. For any maximal weight A, the multiplicity of 
A — nS (n € N) is known to be equal to p(n), the number of partitions of n. A 
construction of the basic representation in principal grading is realized on the space 
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r( 3 ) = C[tj; j > 1, odd, j =k 0(mod3)] (@). A P-function P A (i) is not necessarily 
contained in . However, if the strict partition A is a 3-bar core, then P A (t) G 
and in fact P\(t) is a maximal weight vector. More generally we "kill" the variables 
(j > 1, odd) in the P-function P\(t) and consider the reduced P-function: 



pf(i) :=P A (t)| t3=t9= ... = oGr( 3 ). 

>(3)/ 



A 

It is shown in |14| that P^\t) is a weight vector for any strict partition A, and that 

( 31 

{P^ (t); A is a strict partition with no part divisible by 3} 

={pj 3) (t); A is a strict partition with X bq(3) = (0, A b [l])} 

form a weight basis for T^ 3 K The weight of a reduced P-function with a given 
strict partition A is known as follows. Draw the Young diagram A and fill each cell 
with or 1 in such a way that, in each row the sequence (010) repeats from the 
left as long as possible. If k (resp. k{) is the number of 0's (resp. l's) written 
in the Young diagram, then the weight of the corresponding reduced P-function is 
Ao — fco^o — k\a.\. A removable i-node (i=0,l) is a node m of the boundary of A 
which can be removed. An indent i-node (i=0,l) is a concave corner on the rim of 
A where a node [71 can be added. The action of q to the reduced P-function P^ (t) 
is described as follows: 

ne£l(X) 

where £*(A) is the set of the strict partitions which can be obtained by removing a 
removable i-node from A, and 

/^ 3) = E ^ 3) < 

where J-\ (A) is the set of the strict partitions which can be obtained by adding an 
indent i-node to A. For instance 

„ p(3) _ p(3) , p(3) 
e °' r (4,3,l) ~~ (4,2,1) "T" '^(4,3)' 

f p(3) _ p(3) , p(3) 
J ir (4,3,l) ~ (5,2,1) + (4,3,2)- 

Another realization of the basic representation is known, one in the homogeneous 
grading. The isomorphism between principal and homogeneous realizations is given 
by Leidwanger ||. Put 

B = C[uj, s 2 j-V, j > 1]- 

Define the mapping <E> by 

$ : T^B®C[q,q- l l 
P x {t) — > 2P( A )^(A)P Ano] ( S )^ i , [1] H®g" l(A) , 



where 



A.--1 



pw = E 

Ai^O (mod 3) 

and m(A) is determined by drawing the 3-bar abacus of A: 

m(A) = (number of beads on the first runner of A) 

— (number of beads on the second runner of A). 

For example 

$(^(7,5,3,1) (*)) - 8P (1) («)S( 2 ,1,1) (u) ® q. 
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Leidwanger shows that <I> is indeed an isomorphism and that, if we denote by V 
the subalgebra of B generated by u%j and 2 2 i~ 1 U2j-i — S2j-i (j > 1), then 

$(r (3) ) = v ocfeg- 1 ]. 

The representation of g on V ® C[g, q _1 ], which is induced by is the basic 
representation in the homogeneous grading. In fact, if we define the degree in 
V^Cfaq- 1 ] by 

deg f(u, s) <g> q m = 2 deg f(u, s) + m 2 , 
then deg <E>(Pj 3 ^) is equal to the number of 0-nodes in A. 

6. Rectangular Schur Functions and 

Let £ be a positive integer and = (3£ — 2, 31 — 5, • • ■ , 7, 4, 1). Each cell of 
the Young diagram of Ag is supposed to be filled with or 1 as in Section ||. Let 
T™{Ai) (0 < m < £) be the set of the strict partitions which are obtained by adding 
m |T"| 's to Ai. It is obvious that |JF™(A£)| = (^). We are now ready to state our 
main result in this paper. 

Theorem 6.1. 

(2) E ^(m)<V [1] = S(£, m)p 2 O Sb(«-m : m), 

fie^f (A«) 

where 

(0<m<|) 



It is shown in [ [14] that, in the principal realization of the basic representation 
of Af J , the P-functions P Al (t) = P A '(t) (£ > 1) are the maximal weight vectors 
which allow non-zero action of f\. As is explained in the previous section, we have 

-L /f p(3)= £ P (3). 

The left-hand side of (||) is nothing but the image of ^f[ n P A 3) under the Leid- 
wanger isomorphism $ to the homogeneous realization (dropping q" 1 ^ = q l ~ 2m ). 
Note that p(p) = Q for all fi e ?T(Ai). Therefore the formula §) can be thought 
of as the homogeneous realization of the weight vectors which are obtained by acting 
the group SL2 to a maximal weight vector in the basic repre sent ation of A 2 ■ 

The rest of this section is devoted to a proof of Theorem 3.1. We first recall a 
formula for plethysm which is due to Chen, Garsia and Remmel . 

Proposition 6.2. 

Pr°S X = Yl 5 r (n)LR* [Q] ... ^[r-ySn, 

where the summation runs over all partitions fi with empty r-core. 
Proof. Recall the well-known identity |hJ p64 (4.3)] 

i,3 M 

The right-hand side can be written as 

r-l 

i,j k=0 A 1 
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where u> is a primitive r-th root of 1, and yuj r denotes the r-inflation of the variables 
y. A version of Littlewood's multiple formula ||(see also |11 ) reads 

S (yu ) = f Sr ^ ^ LR Uol- , l Mir-q s <'(v r ) if M has e^pty r-core, 
lo otherwise. 

Therefore we have 

E^(<>W) = E *r(M)^(*)E £J ^[0],-,/*[r-l]^(l/ r ) 

Picking up the coefhcients of S\(y r ), we see that 

as desired. □ 

Our second proof also relies on Littlewood's multiple formula and the orthog- 
onality of the Schur functions. Though two proofs are essentially the same, they 
look different at a first glance. Readers can skip the following second proof, which 
is included here just as authors' notes. 

Proof. Let x^ k ' (k = 0, 1, • • ■ ,r — 1) be an infinite family of variables x^ = 
(x± , x% ,•••)■ A definition of the Littlewood- Richardson coefficients is as follows: 

S A (x<°), • • ■ , xl r -V) = £ LR^o.... ^r-rS^x®) . . . S ^ ( X (^), 

where the summation runs over the r-tuples of partitions (fi , • • • , /i r_1 ). Putting 
a;( ) = • • ■ = a^ 1 " -1 ) = x r , we have 

(3) S x (x r , -..,x r )=J2 L K°,- ,^ S A* r ) ■ ■ ■ V" 1 

For an r-tuple (//*, • • • , p r ~ 1 ) of partitions, let fi denote the single partition which 
has empty r-core and has r-quotient given by (/i[0], • • ■ , /i[r — 1]) = • • • , /i r_1 ). 
Then, by Littlewood's multiple formula, the right-hand side of (|[) equals 

J2$r(n)LR* [ol ... Mr _ 1] S fl (xuj r ), 
p 

where the summatio n ru ns over all partitions p with empty r-core. The formula 
stated in Proposition 6/2 is equivalent to 

(4) ^ LR* m ... M \ r -i]Sn(xuj r ) = y^^LR^ l0] ... ulr _ 1] S fJ .(x, ■ ■ ■ ,x). 

p p 

By the Frobenius formula (h], pi 14] we have 

P 

where the summation runs over all partitions p = (l mi 2 r " 2 • • • ). It is easy to see 
that 



Pk(xLL> r ) 



rpk(x) if k = (mod r), 
otherwise. 



Hence, for proving (Q), we only need to show that 
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for the partitions p which are not of the form ra. Let n be fixed. For a partition A 
of n and a partition p of rn whose r-core is empty, put 

Suppose that p € P rn is not of the form ro~{o~ £ P n ). Then, by the orthogonality of 
the characters of the symmetric group, we see that 

o= E x m Mx m (p) 

)J,£Pm 



= E ( E^xV))*^) 



= E E l ^^p) 

Here the second equality is a direct consequence of Littlewood's multiple formula. 
Since the partition a S P n is arbitary, we can conclude that 

E woo = o 

for any partition A € P n as desired. □ 

A partition A = (Ai,-- - , A2«) of 2nm is said to be (n,m)-balanced if A; + 
A 2n +i-i = 2m for 1 < i < n (g, pl56, Def 2.1]). We denote by W(n,m) the 
set of (n, m)-balanced partitions. There is a one-to-one correspondence between 
the (n, m)-balanced partitions and pairs (a, /?) of partitions which are complemen- 
tary relative to the rectangle m): 



B 



Lemma 6.3. Let a and f3 be partitions complementary relative to the rectangle 
D(n,m). If the partition has empty 2-core, and 2-quotient then p is 

{n, m)-balanced. 

Proof. Let p — (fix, • • • , P2n) be a partition of 2nm whose 2-core is empty. Suppose 
that the 2-abacus of p + ($2n can be obtained by the following. 

(1) Put n beads on the 0-th runner so that the biggest position at most 2(n + 
m — 1). 

(2) Put n beads on the first runner in exactly the same way as the 0-th runner. 

(3) Turn over the first runner (together with the beads) up to the position 2(n + 
m) — 1. 

Looking at the resulting 2-abacus, the 2-quotient of p satisfies the condition 



M0]i + /4i] 



n+l— i 



n (1 < i < n). 



Namely p[0] and p[l] are complementary relative to the rectangle □(n,m). Then 
Pi + P2n+i-i counts the holes up to the position 2(n + m) — 1, which is independent 
of i and equals 2m. This means that p is (n, m)-balanced. □ 



Combining Lemma 6.2 with (Q) in Section ^, the plethysm of rectangular Schur 
function is rather simply expressed. 
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Proposition 6.4. @, § 

/i£zVK(n,m) 

Next we need to know the relation between the two sets of partitions, W(£—m, m) 
and r^{k t ). 

Lemma 6.5. W(l-m,m) = {(J, b [l]\(J, € ^f(A £ )}. 
Proof. Since 

|^-m,m)| = |{ M 6 [l]|MeJr(A,)}|, 

we only have to show that /i b [l] G W(£ — m, m) for any \i € ^"{"(A^). Recall the 
relation between the 3-bar quotients and the 3-quotients: 

» b [l] = D(»)[l}. 

First we see that the 3- abacus of D(Ae) is 

1 



® 
® ® 



(WT ) (WT ) 3£ - 1 
3£ M 3^ + 2 
3^ + 3 (am) 3£ + 5 



6£ - 3 (u^T) U-l 



£ + 1 



2( 



If we add the indent 1-node to Ai at the «-th row, then, in the 3- abacus of D(Ai), 
the beads at 3i — 2 and 6£ — 3i + 1 move to 3i — 1 and 6£ — 3i + 2, respectively: 



® 
© 



© 
@ 



(3i- 


-3) 


(3^- 


-3) 



3i 



3£ 
3£ + 3 



(31-2 ) 
(31+1 ) 
( 31+4 ) 



2 

5 

dED 

31-1 
3^ + 2 
3£ + 5 



6C 



3i 6£ — 3i + 1 (6^-3i+2) 
6£-3 (6t=2) U - 1 



1 



2£-i + l 



2( 



Adding indent 1-nodes successively, we see that, in the 3-abacus of -D(/i) (// € 
JF™(A^)), the beads at «i-th, ?2-th, « m -th rows in the first runner shift to 
the second runner as well as the beads at ii-th, «2-th, • • • , i m -th rows from the 
bottom. Then £)(//) [l]j + D(^)[l] 2 (^_ m ) + i_j counts the number of the holes of the 
first runner up to the 2£-th row; that is 2m. This proves that /i b [l] = £>(//) [1] £ 
W(£-m,m). □ 



Combining Proposition Ij^J and Lemma 3.5 we see so far that 

S2(p b [l])S li b[x] =P2 o <Sp(*_ m , m ). 
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To finish the proof of Theorem p.l| we have to look at the sign factor carefully. Let 
fi be any partition. We count the number of inversions of the permutation 02 (/^t) 
corresponding to /i. Form the 2-abacus of //. For the i-th bead (under natural 
numbering) let no(i) — hq (resp n±(i) — n\) be the number of beads on the 0-th 
(resp. first) runner at the smaller position than the bead in question. For each bead 
on the 0-th (resp. first) runner we attach a non-negative integer by the following 
rule: 

(1) • • • if no > ni (resp. tiq < n\ + 1), 

(2) rii — rto(resp. no — ri\ — 1) • • • if uq < n\ (resp. tiq > ri\ + 1). 

If the sum of these numbers over all beads on the 2-abacus is q, then the 2-sign 
S2(fJ-) i s equal to (— l) 9 . Here we illustrate the procedure with an example: 



©0 

2 ®o 

® 2 5 

©1 7 

®o 9 



fi = (9, 8, 8, 7, 6, 5, 5, 5, 5, 4, 3, 2, 2, 1) € W(7, 5) 




^0 <A3fl 

14 © 

16 © 

18 ©0 

©2 21 

©! 23. 



. , , _ ( 1 2 3 4 5 6 7 8 9 10 
<W-sgn^ 2o 4q la 3i 5q 7q 6i 9q gi 10q 

= (_i) 2 + 1 + 1 + 1 + 2 + 1 = 1 

We now assume that fi is an element of W(l — m,m). Let i* = 2(1 — m) — i + 1 
for 1 < i < 2(1 — n). The bead configuration of fi has the following symmetry. If 
the i-ih bead (under natural numbering) is at the position k, then the z*-th bead 
is at the position 21 — k — 1. Thanks to this symmetry, we can count the number 
of inversions of 02 (m) only by looking at the first half of the beads. Suppose that 
the i*-th bead (1 < i < £ — m) is on the first runner and if no(i*) > n\(i*) + 1. 
Note that this condition is equivalent to saying that the «-th bead is on the 0-th 
runner and no(i) > n\(i). Then by the above rule the number no(i*) — ni(i*) — 1 
is attached to that bead, which is equal to uq(i) — n\(i). Similar considerations for 
other cases lead to the following rule of number attachment: For each of the first 
£ — m beads we attach a non-negative integer. Suppose that the bead is on the 0-th 
(resp. first) runner. Then attach 

(1) ' no — ni(resp. n\ — no + 1) ■ ■ • if no > ni(resp. no < ni + 1), 

(2) ' ni ~ no(resp. no — ni — 1) • • • if no < n\ (resp. no > n\ + 1). 

Note that the number attached is congruent modulo 2 to the number of holes in the 
smaller positions than the bead in question. Hence the sum of attached numbers 
to the first £ — m beads is congruent modulo 2 to fJ.g- m +i + • • • + fi2(£-m)- As a 
consequence we see the following lemma which is stated in || . 

Lemma 6.6. For fi 6 W(£ — m, m), 



11 12 13 14 \ 
12 14 ll a 13i J 



5 2 (fi) = (_l)/**-«+i+-+rt«-m). 
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As an example, the 2-sign of the above \i G W(7, 5) is computed by looking at 
the upper half of the 2-abacus. 

0i 

2 ® 2 

® 2 5 

©i 7 

®o 9 

©i ©i 



£ 2 (/i) - (-1)1+2+2+1 + 1 + 1 

= (_l) 5 +5+4+3+2+2+l _ 1 



The following lemma concludes the proof of Theorem 6.1 
Lemma 6.7. 

'(-!)(") (0<m< |) 



5 2 (^[1})6 3 Q,) 



a<m<£). 



V 2 

Proof. Each step will be discussed in a parallel way for the complementary two 
cases: (1) m < £/2 and (2) m > £/2. For A e = (3{£ - 1) + 1, ■ • • ,7,4, 1) we define 
the reference point 

(1) ft=At + (p,-- , 0,1, 0,1, 0,-- ,0,1), 

" v ' 

2m-l 

(2) A=A^ + (1,-- ,1,0,1, 0,1,0,--. ,0,1). 

S ' 

2{l—m) 

Let [i be obtained by 

M = A^ + (0,"- ,0,1,0,"- ,0,1,0,"- ,0,t,0,-" ,0)6 ^(A*). 
We define a sequence 

(1) a(/x) = {e + l-i m J+l-i m -i,--- J+l-h) - (1,3,5,-" ,2m- 1), 

(2) a{fj,) = (£ + l-i m ,l + l-i m - 1 ,--- ,£ + l-h)- 

(1, 3, 5, • • • , 2(£ - to) - 1, 2{l - m) + 1, 2{£ - m) + 2, • • • , £). 
Note that a(/i) indicates the inversions encoded in 03 (/i). Hence 

Saifi) = (-i)«Wi+"'+«W». 
We define a sequence 7 (/x) by 

7(i")ft = im-k+i - (m - A; + 1) (1 < k < to). 

Since 

(1) 7(M) = - to,^ - rn - 1, • • • ,£ - 2m + 1), 

(2) 7 (M) = (£-m,£-m-l,--- ,1,0,--- ,0). 
One has 

a(i")+7(i") =7(M). 

Also we see that 7(/i) = (*/i b [l] m+1 , ■ • • ,* ^ b [l] M1 ). From Lemma 6J3 we see that 

(5 2 (A< fe [l]) = (-l) 2m ( £ - m )-((^- m )" l +l7(M)l) — (_l)"i(^-m)+l7(M)l ; 

where | 7 (^t)| = 7(^)1 + ■ ■ ■ + l{^) m - Therefore one obtains 

(1) 5 2 ( f l b [l])S 3 {^) = (_l)m(^-m)+|a( M )|+| 7 ( M )| = (_!)(?) 

(2) ^ 2 (/i b [l])4(M) = (-l)C" = +1 )+^- m ) m . 
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□ 

Example 6.8. (1) We consider the case of (£, m) = (7,3). Then we have 

M= (19,16,14,10,8,4,2). 
Suppose that /x = (19, 17, 14, 10, 7, 4, 2). Now we obtain the following sequences: 



a{h) = 


(1,3,5)- 


(1,3,5) = 


(0,0,0) 


a{n) = 


(1,5,6)- 


(1,3,5) = 


(0,2,1) 


7(A) = 


(7,5,3)- 


(3,2,1) = 


(4,3,2) 


lip) = 


(7,3,2)- 


(3,2,1) = 


(4,1,1) 



We have 

5 2 (» b [l}M») = (-i)® = -i- 

(2) We consider the case of (£, m) = (7, 5). Then we have 

fi= (20,17,14,10,8,4,2). 
Suppose that \x = (19, 17, 14, 11, 8, 5, 1). Now we obtain the following sequences: 

a(M) = (1, 3, 5, 6, 7) - (1, 3, 5, 6, 7) = (0, 0, 0, 0, 0) 
a(p) = (2,3,4,5,6)- (1,3,5,6,7) = (1,0,-1,-1,-1) 

7 (£) = (7, 5, 3, 2, 1) - (5, 4, 3, 2, 1) = (2, 1, 0, 0, 0) 
7 (m) - (6, 5, 4, 3, 2) - (5, 4, 3, 2, 1) = (1, 1, 1, 1, 1). 

We have 

( 5 2 (/[1])4(m) = (-1)© +10 = -1- 
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RECTANGULAR SCHUR FUNCTIONS AND THE BASIC 
REPRESENTATION OF AFFINE LIE ALGEBRAS 



HIROSHI MIZUKAWA AND HIRO-FUMI YAMADA 



Abstract. An expression is given for the plcthysm P2 o Sfj, where p2 is the 
power sum of degree two and Sq is the Schur function indexed by a rectangular 

partition. The formula can be well understood from the viewpoint of the basic 

(2) 

representation of the affine Lie algebra of type A, 2 



1. Introduction 

The aim of this paper is to prove a formula concerning Schur functions indexed 
by rectangular Young diagrams. More precisely we will give an expression of the 
plethysm p 2 o Sa( n ,m) where p 2 is the power sum of degree two and <Sh(n,m) is the 
Schur function indexed by the rectangular partition (m™) (Theorem 6.1). In fact 
the formula is a version of one given in [2]. Our main contribution in this paper 
is to understand their formula from the viewpoint of representations of affine Lie 
algebras. By looking at the homogeneous realization of the basic representation of 

(2) 

the affine Lie algebra of type A 2 , we can shed another light to that formula. Our 
point of view relies on the isomorphism between the principal and homogeneous 
realizations of the basic representation, which was first obtained by Leidwanger [8] . 
As a merit of our understanding, it becomes clear that the formula gives an explicit 
expression of a homogeneous polynomial r-function of a hierarchy of nonlinear 
differential equations. A similar formula for the affine Lie algebra of type is 
already given in [5]. 

The paper is organized as follows. In Section 2 we fix some notations concerning 
the symmetric functions. Section 3 is devoted to a brief review of division calculus 
of partitions, namely, cores and quotients and their bar analogues. In Section 4 we 
give a simple combinatorial proof of a formula which is presented in [5] . Cores and 
quotients of partitions are required in proving, while in [5] the vertex operators are 
used in the proof. In Section 5 we discuss the basic representation of the affine Lie 
algebra of type A 2 . The main result is given in Section 6. 

2. Symmetric Functions 

We denote by P n the set of all partitions of n, SP n the set of all strict partitions 
of n and OP n the set of those partitions of n whose parts are odd numbers. Let 
Xp be the irreducible character of the symmetric group S n , indexed by A <G P n and 
evaluated at the conjugacy class p, and £p be the irreducible negative character of 
the double cover S n (cf. [4]), indexed by A £ SP n and evaluated at the conjugacy 
class p. Here we recall symmetric functions of variables x = (x\, X2, • • • ) which are 
discussed in this paper. Let p r {x) — X)i>i x i be the power sum symmetric function 
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6(A) 



for r > 1. The Schur functions are defined as follows: 

For A £ SP n define Schur's Q-fu nc ti° n and P-function by 

Q x (x) = J2 2^™+^>>/VC p A Pp(^ 
peOP n 

P x (x) = 2- l( ^Q x (x), 

where 

if n — l(X) is even, 

1 if n — l(X) is odd. 

Let x = (xi, X2, ■ ■ ■ ) and y = (j/i, J/2, ■ " " ) be variables. We write 

= (ari2/j;* > 1, j > i)- 

When y is specialized as y = (1, u>, uj 2 , • • • , w r_1 , 0, 0, • • • ) for u = ex^>{2TT^/^l/r), 
we write 

xu r = xy. 

For a symmetric function F(x), the plethysm p r o F(x) with the r-th power sum 
p r is by definition [10, pl35] 

Pr oF(x) =F(x r ). 

3. Division Calculus of Partitions 

Let r (r > 2) be an integer. For a partition A = (Ai,--- ,A m ), m is al- 
ways supposed to be a multiple of r. Put S m = (m — 1, m — 2, . . . , 1, 0) and 
£ = • • • ,£ m ) = A + (5 m . We set, for k = 0, 1, • • • ,r- 1, 

M k = {^^-\ti = k{mod r)} 
r 

and 

e< fc > = (d fe) , . . . ,d fc >), e M fe , a < i < mk ), ^ fc) > . . . > &i 

We write 

X[k] = ^-S mk . 

Definition 3.1. The collection 

X^ = (A[0],A[1],... ,A[r-l]) 

is called the r-quotient of the partition A. 

For the strict partition £ = X + S m we put a set of beads on the assigned positions 
as follows: 



® 1 ... (ED 
r ( T+T) ... 2r - 1 
2r (EED • • • 3r ~ 1 



This figure represents £ = (••• , 2r — l,r + l,r — 1,0). This beads configuration 
is called the r-abacus of A. A position is called a hole if it is not occupied by 
a bead. Next we set C k = {rs + k\0 < s < m k — 1} and C = Ufe=oCfc- Let 
£ = • • • . fm) be defined by & £ C, £i > 6 > • • • > £m- We write 

A c(r) =|-* m . 
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Definition 3.2. The partition is called the r-core of the partition A. 

Example 3.3. We compute the 3-core and the 3-quoticnt of A = (7, 7, 4, 4, 1). We 
see that 



Therefore 
And we have 

Therefore 



£ = (12, 11,7,6,2,0), and 

M = {4, 2, 0}, Mi = {2}, M 2 = {3, 0}. 

A[0] = (2,1,0), A[l] = (2), A[2] = (2,0). 

Co = {6,3,0}, Ci = {l}, C 2 = {5,2}, 
| =(6,5,3,2,1,0). 

A c < 2 ) = (1,1). 



Next we explain the r-sign through the example above. Number the beads in 
the following two ways. 

(1) The natural numbering according to the increasing order. 

(2) The 3- numbering according to the layers. 

natural numbering 3-numbering 

®1 1 ©2 ®1 1 ©3 

3 4 5 3 4 5 

©3 ©4 8 ©4 ©2 8 

9 10 @ 5 — "9 10 @ 5 

©6 13 14 ©6 13 14 

When we compare the natural numbering with the 3-numbering we get a permuta- 
tion 

/ 1 2 3 4 5 6 
ff3(A) ^ 1 3 4 2 5 6 

The 3-sign of A, which is denoted by £3 (A), is defined to be the sign of (73(A): 

5 3 (X) = sgner 3 (A) = -1. 

We now proceed to be the division calculus of strict partitions. Though the 
following arguments are valid for any positive odd integer r (cf [12, 15]), we need 
in this paper only the case of r = 3. 

Definition 3.4. Let A = (Ai, • • • , A;) be a strict partition. We define the double 
of A by 

£>(A) = (Ai,--- ,A, I Ai-1,--- ,A,-1), 
in the Frobenius notation. 

X X X X 

Example 3.5. Take A = (4, 2, 1) = x x . The double of A is 

x 



D(A) = (5,4,4,1) 






X 


X 


X 


X 








X 


X 













X 





There is a remarkable property of D(X) as follows. 
Proposition 3.6. ([10]) Let X be a strict partition. 
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(1) There exist strict partitions \ bci - 3 ) and X b [0] such that 

L>(A bc(3) ) = L>(A) c(3) , 
D(A b [0]) = £>(A)[0]. 

(2) D(A)[2] is the partition conjugate to D(X)[l\. 

Definition 3.7. (1) The strict partition \ bc ^ is called the 3-bar core of A. 
(2) The collection 

X bq(3) = (X b [0},\ b [l}) 

is called the 3-bar quotient of A. 

Example 3.8. We compute the 3-bar quotient of A = (11,9,8,7,6,4,2). Adding 
O's in the tail of D(X), if necessary, we always assume that the size of the vector 
D(X) is the multiple of 3. We see that 

D(X) + S 12 = (23, 21, 20, 19, 18, 16, 14, 11, 9, 7, 2, 0), 

where 5\2 = (H, 10, 9, 8, 7, 6, 5, 4, 3, 2, 1, 0). To compute the 3-quotient of D(X), we 
put a set of beads on the positions assigned by D(X) + Si 2 as follows. 

® 1 © 

3 4 5 

6 © 8 

© 10 © 

11 ™ © -((4, 4, 2), (4, 4, 2), (3, 3, 2, 2)). 

15 © 17 

@ © © 
© 22 © 



Read each runner from the bottom and count the number of holes above each bead. 
Thus we have the corresponding partition D(X)[i] (i = 0, 1,2). In this case the 3- 
quotient of D(X) reads ((4, 4, 2), (4, 4, 2), (3, 3, 2, 2)). This gives the 3-bar quotient 
of A; 

X b ^ -((3, 2), (4, 4, 2)). 
Moving each bead upwards in the runner successively as far as possible, we get 

© © © 

© © © 

© © © 

© 10 © ->(3,1)=D(2). 

12 13 © 



Thus we sec that D(X) C ^ = (3, 1) and X bc ^ = (2). 

A standard exposition of 3-bar cores and quotients is as follows ([15]). We record 
the given strict partition A directly: 

1 © 

3 © 5 
© © © 
© 10 © 



for A = (11, 9, 8, 7, 6, 4, 2). This bead configuration is called the 3-bar abacus of A. 
One obtains the 3-bar quotient of A by the following game. 
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(1) The parts of the strict partition A b [0] are nothing but the levels of the beads 
in the 0-th runner. 


3 

© ^A b [0] = (3,2). 
® 



(2) Make a sequence consisting of and 1 by the following (a)-(c). 

(a) Read the first runner from the top downwards attaching 1 at the position 
with a bead, and at the position without a bead. 

(b) Read the second runner from the bottom (infinite away) upwards at- 
taching at the position with a bead, and 1 at the position without a 
bead. 

(c) Make a two-sided infinite sequence by concatenating two sequences ob- 
tained the above procedures (a) and (b); (a) to the right and (b) to the 
left. 



lo 


©0 


©1 


5i 


©1 


©0 


10o 


©0 


13 


14i 



10010|0110 -» A b [l] = (4,4,2). 



Here 1 = • • • 111 and = 000 • • • . 

(3) Count the number of 0's left to each 1, and we have the partition A b [l]. 
The 3-bar core of A is given directly by removing beads according to the following 
rule. 

(1) Remove all beads from 0-th runner. 

(2) Remove the beads pairwise from the first and the second runners simultane- 
ously. 

(3) Move the remaining beads upwards in the runner successively as far as pos- 
sible. 

The resulting bead configuration gives A bc ' 3 ^. 

1 © 

3 4 5 

6 7 8 -> A bc(3) = (2) 

9 10 11 



To define the 3-bar sign 83 (A) of the strict partition A, we draw the 3-bar abacus 
of A. Number the beads in the following two ways. 

(1) The natural numbering according to the increasing order. 

(2) The 3-bar numbering according to the layers. 

(a) Number the beads on the 0-th runner increasing order. 

(b) Number the beads on the first and the second runners according to the 
increasing order of layers. For each pair, number the bead on the second 
runner before that on the first runner. 

(c) Number the rest of the beads in increasing order. 

If we take A = (11, 9, 8, 7, 6, 4, 2) as before, then the two numbering are as follows 
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natural numbering 



3-bar numbering 



1 ©! 

3 © 2 5 

©3 ©4 ©5 

©6 10 © 7 



1 © 3 

3 © 4 5 

©1 ©6 ©5 

©2 10 ©7 



Compare the two numberings, we get a permutation 



_ / 1 2 3 4 5 6 

ff3(A) -^ 3 4 1 6 5 2 



7 
7 



) 



The 3-bar sign of A is defined to be the sign of 173(A): 

^3 (A) = sgna 3 (A) = -1. 



4. Rectangular Schur Functions and A\ 



In this section we give a simple combinatorial derivation of a formula which is 
presented in [5] in connection with the basic representation of affinc Lie algebra of 
type A^p . Here the Schur functions are described in terms of the so called Sato 
variables: Uj = Pj/j(j > 1)- We will denote them by S\(u). For a given partition 
we draw the Young diagram and fill each cell with or 1 in such a way that (i, j)-cell 
is numbered with (resp. 1) if i + j is even (resp. odd). 

Let I be a positive odd integer and Ag = (£, £ — 1, • • • , 1, 0) be the staircase 
partition of length I. The partitions Ag (£ > 1, odd) are characterized as that they 
are 2-cores such that [T] can be added in each row. Let ^"(A^) (0 < m < I) be 
the set of partitions which are obtained by adding m |T"|'s to Ag. It is obvious that 



for < to < I. 

Before proving this theorem, we give a definition. A pair of partitions (a, /?) 
is said to be complementary relative to the rectangle D(n, to) if a is contained in 
□ (n, to) and the rest $ = 0(n, to) — a is the 180°-rotation of (3: 




= (-l) Wlll S M o](«)S V[1] = S a(e+1 _ m , n) (u - v) 



Ate^r(A f ) 




Note that the number of such pairs is equal to (™^ ! m ) ■ By the well-known rule for 
computing the Littlewood-Richardson coefficients, it is easily seen that 



(1) 




Proof of Theorem 4.1. It is well known [10, p72, (5.9)] that 



S x (u-v) = Y,(-l)WLRl S a (u)S tf3 (v), 



(a,/3) 
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for any partition A. By the above remark we have 

Sa(e+i-,n, m )(u - v) = ^2 (-l) lPl S a (u)St p (v), 

where the summation runs over all pairs (a, (3) of partitions complementary relative 
to the rectangle 0(£ + 1 — m, m). On the other hand, by looking at the 2-abacus of 
/i G JF™(A^), we see that /x[0] and */z[l] are complementary relative to the rectangle 
U(l + 1 - to, to). 

□ 

Theorem 4.1 could be understood as an expression of the weight vectors which 
are obtained by acting the group SL 2 to a maximal weight vector in the basic 
representation of A^K In this respect the formula gives an explicit description 
of a homogeneous polynomial r-function of the nonlinear Schrodinger hierarchy, 
and a Virasoro singular vector as well. The reader is referred to [5] for the details, 
where the formula is proved by using the vertex operators. These two proofs can be 
transformed to each other via the isomorphism, given by Leidwanger [8], between 
the principal and homogeneous realizations of the basic representation of . 

5. Basic Representation of A^ 
We discuss in this section the basic representation of the afhne Lie algebra of 

(2) 

type A 2 following [6, 7]. Here the Schur functions, Schur's P and Q-functions 
are described in terms of the so called Sato variables: Uj = pj/j (j > 1) for S\, 
Sj = 2pj/j (j > 1, odd) or tj = 2pj/j (j > 1, odd) for P\ and Q\. We will denote 
them by S\(u), P\(s), Q\(t), etc. Put T = C[t,; j > 1, odd], whose basis is chosen 
as {Pa; A e SP n , n€N}. Associated with the Cartan matrix 

i a ij)i,je{0,l} = 

the Lie algebra Q of type A^ is generated by a, fi, aY(i = 0, 1) and d subject to 
the relations 

[®i , a] ] = , [a- ,ej} = dijej, [a( , f 3 } = - fj , 
fe. fj] = 8ij<*V, (adeiY-^ej = (ad/O^^/j =0 (i ? j), 

and 

[d, a^} = 0, [d, ej] = 5 jfi ej, [d, fj] = -8 ji0 fj. 

The Cartan subalgebra f) of g is spanned by , a\ and d. Choose the basis 
{a , ai, Ao} for the dual space f)* of f) by the pairing 

<ati,ai> = a,ij, < af , A >= ^,o, 

< d,ctj > = Sqj, < d,A >= 0. 

The fundamental imaginary root is S = 2a + Qi- 

The basic representation of q is by definition the irreducible highest weight q- 
module with highest weight A . The weight system of the basic representation is 
well known: 

P(A ) = {A - pS + q ai ; p > 2q 2 , p, q e lz, p + q e Z}. 

A weight A on the parabola A — 2q 2 S + qct\ is said to be maximal in the sense 
that A + 5 is no longer a weight. For any maximal weight A, the multiplicity of 
A — nS (n € N) is known to be equal to p{n), the number of partitions of n. A 
construction of the basic representation in principal grading is realized on the space 
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r( 3 ) =C[tj; j > 1, odd, j ^ 0(mod3)] ([7]). A P-function P x (t) is not necessarily 
contained in T^- 3 K However, if the strict partition A is a 3-bar core, thenP A (t) e 
and in fact P\(t) is a maximal weight vector. More generally we "kill" the variables 
Hj (j > 1, odd) in the P-function P\(t) and consider the reduced P-function: 

pf (t) :=P A (t)| t3=t9= ... =0 er( 3 ). 

It is shown in [14] that P^\t) is a weight vector for any strict partition A, and that 

(3) 

{P^ (t); A is a strict partition with no part divisible by 3} 

={P$ 3) (t); A is a strict partition with A b<?(3) = (0, A h [l])} 

form a weight basis for r' 3 ). The weight of a reduced P-function with a given 
strict partition A is known as follows. Draw the Young diagram A and fill each cell 
with or 1 in such a way that, in each row the sequence (010) repeats from the 
left as long as possible. If ko (resp. fci) is the number of 0's (resp. l's) written 
in the Young diagram, then the weight of the corresponding reduced P-function is 
A — k a — k\a\. A removable i-node (i=0,l) is a node [T] of the boundary of A 
which can be removed. An indent z-node (i=0,l) is a concave corner on the rim of 
A where a node [7] can be added. The action of jj to the reduced P-function P^\t) 
is described as follows: 

where £/(A) is the set of the strict partitions which can be obtained by removing a 
removable i-node from A, and 

/^ 3) = E ^ 3) > 

where ^"/(A) is the set of the strict partitions which can be obtained by adding an 
indent i-node to A. For instance 

e p(3) _ p(3) , p (3) 
e °- r (4,3,l) — (4,2,1) (4,3)' 

f p(3) _ p(3) , p (3) 
•' 1 - r (4,3,l) — ^(5,2,1) + (4,3,2)- 

Another realization of the basic representation is known, one in the homogeneous 
grading. The isomorphism between principal and homogeneous realizations is given 
by Leidwanger [8]. Put 

B = C[uj, s 2 j-i; j > 1]. 

Define the mapping $ by 

$ : r =i B^C^q- 1 }, 
P x (t) — > 2^ A )5 3 (A)P A6[ o]( S )5 A6[1] H® (Z " i ( A ), 

where 

P w= e rA,:_1 " 

Ai^O (mod 3) 

and m(A) is determined by drawing the 3-bar abacus of A: 

m(A) = (number of beads on the first runner of A) 

— (number of beads on the second runner of A). 

For example 

*CP(7,5,3,i) (*)) = 8P ( i) (s)S (2iltl) (u) ® q. 
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Leidwangcr [8] shows that $ is indeed an isomorphism and that, if we denote by V 
the subalgebra of B generated by u 2 j and 2 2j ~ 1 u 2 j-i — S2j-i (j > 1), then 

The representation of g on V (E> C[g, which is induced by $, is the basic 

representation in the homogeneous grading. In fact, if we define the degree in 
VQCfaq- 1 ] by 

deg f(u,s)(g>q m = 2deg/(u,s) + m 2 , 



then deg $(Pj[ 3 ^) is equal to the number of 0-nodes in A. 



(2) 



6. Rectangular Schur Functions and A 2 

Let £ be a positive integer and = (31 — 2, 31 — 5, • • • , 7, 4, 1). Each cell of 
the Young diagram of is supposed to be filled with or 1 as in Section 5. Let 
!F 1 m (Ai) (0 < m < £) be the set of the strict partitions which are obtained by adding 
m |T"| 's to A^. It is obvious that |J^™(A^)| = (^). We are now ready to state our 
main result in this paper. 

Theorem 6.1. 

(2) ^2 <^(m)<S>[i] = e(£,m)p 2 o Sa(t-m,m), 

Me^r( A «) 

where 

(0 < m < |) 
(-l)(^? +1 ) +(£ - m)m (| < m < £). 



m) = 



It is shown in [14] that, in the principal realization of the basic representation 

(2) (3) 

of A^>, the P-functions P Ae (t) = P A /(t) (I > 1) are the maximal weight vectors 
which allow non-zero action of fx. As is explained in the previous section, we have 

J_ em p(3) \p p (3) 

The left-hand side of (2) is nothing but the image of ^fr P A ] under the Leid " 
wanger isomorphism $ to the homogeneous realization (dropping q m ^ = q e ~ 2m ). 
Note that = ( 2 ) for all fi € J 7 { m -(Ai). Therefore the formula (2) can be thought 
of as the homogeneous realization of the weight vectors which are obtained by acting 

' (2) 

the group SL 2 to a maximal weight vector in the basic representation of A 2 . 

The rest of this section is devoted to a proof of Theorem 6.1. We first recall a 
formula for plethysm which is due to Chen, Garsia and Remind [3]. 

Proposition 6.2. 

where the summation runs over all partitions ^ with empty r-core. 
Proof. Recall the well-known identity [10, p64 (4.3)] 

The right-hand side can be written as 

r-l 

n n( i ^^r 1 = e s^s^yur). 

i,j fc=0 n 
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where u> is a primitive r-th root of 1, and yu> r denotes the r-inflation of the variables 
y. A version of Littlewood's multiple formula [9] (see also [11]) reads 



j J ,_ 1 ]5^(y r ) if (i has empty r-core, 
otherwise. 



Therefore we have 

E^ r )W) = E wwE L ^W---,^-i]W) 

Picking up the coefficients of S\(y r ), we see that 

S X (x r )= E ^M L ^[0],-,Mr-l](/")^(^) 

W /J <=(>-) =0 

as desired. □ 

Our second proof also relies on Littlewood's multiple formula and the orthog- 
onality of the Schur functions. Though two proofs are essentially the same, they 
look different at a first glance. Readers can skip the following second proof, which 
is included here just as authors' notes. 

Proof. Let (k = 0, 1, • • • , r — 1) be an infinite family of variables x^ = 

(x[ k \ \ ■ ■ ■)■ A definition of the Littlewood-Richardson coefficients is as follows: 

S x {x™ , • • • , a^" 1 )) = E LR* ,... (*«») • • • V- (x^), 

where the summation runs over the r-tuples of partitions , • • • , ^ r_1 ). Putting 
x^ = • • • = cc^ -1 ) = x r , we have 

(3) S x (x r , ■ ■ ■ , x r ) = E LR* 0> ... ^-iSpo (x r )--- S^-i (x r ). 

For an r-tuple (fj, , • • • , p r ~ 1 ) of partitions, let ji denote the single partition which 
has empty r-core and has r-quotient given by (/n[0], • • • , /i[r — 1]) = • • • , /i r_1 ). 
Then, by Littlewood's multiple formula, the right-hand side of (3) equals 

E Sr(»)LR* [0]t ... iM[r _ 1] 5 M (a;w r ), 

where the summation runs over all partitions /i with empty r-core. The formula 
stated in Proposition 6.2 is equivalent to 

(4) J2 L K[0],---Mr-n S ^ XW r) = J2 L K[0],---Ar-l] S »( X >--- > X )' 

By the Frobenius formula [10, pi 14] we have 

S^XUr) = ^Z^X^lKj-'ftK)™ 2 • • • , 
P 

where the summation runs over all partitions p = (l mi 2 m2 ■ ■ ■). It is easy to see 
that 



p k (xuj r ) 



rpk(x) if k = (mod r), 
otherwise. 



Hence, for proving (4), we only need to show that 

E^(M)^[o],..,^-i]X' t (p) = 
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for the partitions p which are not of the form ra . Let n be fixed. For a partition A 
of n and a partition /x of rn whose r-core is empty, put 

Suppose that p G P rn is not of the form ra(a £ P n ). Then, by the orthogonality of 
the characters of the symmetric group, we see that 

0= E X^roWifi) 

= E ( E ^V)V(p) 
= E ( E 

AfEP„ \ At ;p<=(-)=0 / 

Here the second equality is a direct consequence of Littlewood's multiple formula. 
Since the partition a e P n is arbitary, we can conclude that 

E w» = o 

for any partition A € P„ as desired. □ 

A partition A = (Ai,--- , \2n) of 2nm is said to be (n 1 m)-balanced if Xi + 
A 2n +i- J = 2m for 1 < i < n ([2, pl56, Dcf 2.1]). We denote by W(n,m) the 
set of (n, m)-balanced partitions. There is a one-to-one correspondence between 
the (n, m)-balanced partitions and pairs (a, 0) of partitions which are complemen- 
tary relative to the rectangle □(n,m): 

Lemma 6.3. Lef a and /3 &e partitions complementary relative to the rectangle 
□ (n,77j). // the partition it has empty 2-core, and 2-quotient (a, (3), then it is 
(n, m)-balanced. 

Proof. Let it = (/ii, • • • , it2«) be a partition of 2nm whose 2-core is empty. Suppose 
that the 2-abacus of /i + S 2n can be obtained by the following. 

(1) Put n beads on the 0-th runner so that the biggest position at most 2(n + 
m — 1). 

(2) Put n beads on the first runner in exactly the same way as the 0-th runner. 

(3) Turn over the first runner (together with the beads) up to the position 2(n + 
m) — 1. 

Looking at the resulting 2-abacus, the 2-quotient of /i satisfies the condition 

n[0]i + /i[l]„+i_; = n (1 < i < n). 

Namely /i[0] and are complementary relative to the rectangle □(n,m). Then 
Mi + M2n+i-i counts the holes up to the position 2(n + m) — 1, which is independent 
of i and equals 2m. This means that it is (n, m)-balanced. □ 

Combining Lemma 6.3 with (1) in Section 4, the plethysm of rectangular Schur 
function is rather simply expressed. 
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Proposition 6.4. [1, 2] 

P2 O Sa(n,m) = ^2 ^(M)^- 

Next we need to know the relation between the two sets of partitions, W(£—m, m) 
and ^r(A^). 

Lemma 6.5. W{£ -m,m) = {ii b [l]\n G JT( A e)}- 
Proof. Since 

|W(^-m,m)| = |{/i 6 [l]|/ieJT , (A / )}|, 

we only have to show that <G — m, m) for any /z € JF{™(A^). Recall the 

relation between the 3-bar quotients and the 3-quotients: 

/[1] = ^)[1]- 
First we see that the 3-abacus of D(Af) is 

® © 2 1 
© © 5 



(WT) (WT ) 31 - 1 
U M 3^ + 2 
3^ + 3 (W) 3^ + 5 



£+1 



21 



M-3 ( WT ) U - 1 

If we add the indent 1-node to Ag at the i-th row, then, in the 3-abacus of D(Ag), 
the beads at 3i — 2 and Q£ — 3i + 1 move to 3i — 1 and 6f — 3i + 2, respectively: 



© 
© 



(3i- 


-3) 


(3<- 


-3) 



© 
© 

3i-2 



3^ 
3^ + 3 



(31-2) 
( 3i+i ) 



(JED 

31- 1 
3^ + 2 
3^ + 5 



( 31+4 ) 

3i 6^-3i + l (e^-3i+2) 



6^-3 



£ + 1 



2^ - i + 1 



2^ 



Adding indent 1-nodes successively, we see that, in the 3-abacus of D(p.) (p, G 
T™{Ai)), the beads at ii-th, 12-th, i m -th rows in the first runner shift to 
the second runner as well as the beads at ii-th, 12-th, • • • , i m -ih rows from the 
bottom. Then D(p)[l]i + D(/j,)[l)2(e-m)+i-i counts the number of the holes of the 
first runner up to the 2£-th row; that is 2m. This proves that fJ, b [l] = e 
W(e-m,m). ' □ 

Combining Proposition 6.4 and Lemma 6.5 we see so far that 

^2 MM^D'ViI] = Vl O Sb(£- m , m ). 

Me^r(A«) 
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To finish the proof of Theorem 6.1 we have to look at the sign factor carefully. Let 
/i be any partition. We count the number of inversions of the permutation cr 2 (aO 
corresponding to /i. Form the 2-abacus of fi. For the i-th bead (under natural 
numbering) let no(i) = hq (resp n\{i) = n\) be the number of beads on the 0-th 
(resp. first) runner at the smaller position than the bead in question. For each bead 
on the 0-th (resp. first) runner we attach a non-negative integer by the following 
rule: 

(1) • • • if no > n\ (resp. no < n\ + 1), 

(2) m — n (rcsp. no — n\ — 1) • • • if n < ri\ (resp. n > n\ + 1). 

If the sum of these numbers over all beads on the 2-abacus is q, then the 2-sign 
(^2 (m) is equal to (— l) q . Here we illustrate the procedure with an example: 



y, = (9, 8, 8, 7, 6, 5, 5, 5, 5, 4, 3, 2, 2, 1) e W(7, 5) 



<r / \ _ / 1 2 3 4 5 6 7 8 9 10 
02 W -sgny 2q 4q ^ 3i 5q 7q 6i 9q gi 10q 

_ £_-g2+l+l+l+2+l _ j 

We now assume that ^( is an element of W(£ — m, m). Let i* = 2(£ — m) — i + 1 
for 1 < i < 2(£ — n). The bead configuration of \i has the following symmetry. If 
the i-th bead (under natural numbering) is at the position k, then the i*-th bead 
is at the position 2£ — k — 1. Thanks to this symmetry, we can count the number 
of inversions of 02(m) om Y by looking at the first half of the beads. Suppose that 
the i*-th bead (1 < i < £ — m) is on the first runner and if n (i*) > n\{i*) + 1. 
Note that this condition is equivalent to saying that the i-th bead is on the 0-th 
runner and no(i) > n\{i). Then by the above rule the number no(z*) — n\{i*) — 1 
is attached to that bead, which is equal to n (i) — n\(i). Similar considerations for 
other cases lead to the following rule of number attachment: For each of the first 
£ — m beads we attach a non-negative integer. Suppose that the bead is on the 0-th 
(resp. first) runner. Then attach 

(1) ' n — ni(resp. m — n + 1) • • • if n > ni(resp. no < n\ + 1), 

(2) ' ni — no(resp. no — ni — 1) • • • if no < n\ (resp. no > ni + 1). 

Note that the number attached is congruent modulo 2 to the number of holes in the 
smaller positions than the bead in question. Hence the sum of attached numbers 
to the first £ — m beads is congruent modulo 2 to /^_ TO+ i + • • • + H2(t- m )- As a 
consequence we see the following lemma which is stated in [2] . 

Lemma 6.6. For fj, e W(£ — m, m), 

8 2 (fi) = (-l)«-"'+ 1 +---+''2(«-m)_ 






©0 


2 


©0 


©2 


5 


©1 


7 


©0 


9 


@0 


®i 


©0 


©i 


14 


©0 


16 


©0 


18 


©0 


©2 


21 


©1 


23. 



11 12 13 14 \ 
12 14 11 2 13i J 
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As an example, the 2-sign of the above fj, e W(7, 5) is computed by looking at 
the upper half of the 2-abacus. 

0i 

2 ® 2 

® 2 5 

©i 7 

®o 9 

@i @i 



8 2 (p) = (_ 1) l+2+2+l+l+l 

= (_l) 5 + 5 + 4 + 3 + 2 + 2 + 1 = 1 

The following lemma concludes the proof of Theorem 6.1. 
Lemma 6.7. 

-1)(?) (0 < m < |) 



62(ji b [l])5 3 (ji) = 



i (-i)r? +i )+(^v 2> ( |< m <£). 

Proof. Each step will be discussed in a parallel way for the complementary two 
cases: (1) m < 1/2 and (2) m > 1/2. For = (3(£ - 1) + 1, • • • , 7, 4, 1) we define 
the reference point 

(1) fi= A t + (0, • • • , 0, 1,0,1,0 ■■■ ,0,1 ), 

2m-l 

(2) fi= A e + (1, • • • , 1, 0,1,0,1, ,- •• ,0,1 ). 

S V * / 

2(^-m) 

Let ^ be obtained by 

*1 *2 im 

f i = A e + ((],■■■ ,0, 1,0,- •• ,0, l,0,--- ,0, 1,0,--- ,0)e^r(A^). 
We define a sequence 

(1) a{p) = (£+l-i m ,£+l-i m _ u -- - ,e+ 1 -h) - (1,3,5," ■ ,2m- 1), 

(2) a(ji) = +l-i m ,f +l-i m _i,-- - 

(1, 3, 5, • • • , 2{l - m) - 1, 2(1 - m) + 1, 2(1 - m) + 2, ■ ■ ■ , f). 
Note that indicates the inversions encoded in 03 (/i). Hence 

We define a sequence j(/j,) by 

l(v)k = im-k+i - (m - k + 1) (1 < k < m). 

Since 

(1) 7 (/x) = - m, £ - m - 1, • • • , t - 2m + 1), 

(2) 7(£) = (*-m,*-m-l,---,l,0,---,0). 
One has 

o 

"(m) +7(m) = 7(M). 

Also we see that 7(/z) = ('^ b [l] m+ i, • • • /i b [l] Ml ). From Lemma 6.6 we see that 

S 2 (p b [l}) = (_l) 2m ( £ -" l M( £ -" l ) m +lT(A 1 )l) = (_l)"»(^-™) + l7(^)l ; 

where |7(/i)| = 7(^)1 H h l(^)m- Therefore one obtains 

(1) 5 2 (A* 6 [l])*s(/i) = (-l) m < < - m >+|a(»0l+l7(/0l = (-l)(?) 

(2) 6 2 (^[l])S 3 (p) = 
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□ 

Example 6.8. (1) We consider the case of (£, m) = (7,3). Then we have 

M= (19,16,14,10,8,4,2). 
Suppose that fj, = (19, 17, 14, 10, 7, 4, 2). Now we obtain the following sequences: 

<*(£) = (1,3, 5) -(1,3, 5) = (0,0,0) 
a(p) = (1,5, 6) -(1,3, 5) = (0,2,1) 

7 (A) = (7, 5, 3) -(3, 2,1) = (4, 3, 2) 
7 (M) = (7,3,2)-(3,2,1) = (4,1,1). 

We have 

<5 2 ( M "[1])4(M) = (-l)(')=-l. 
(2) We consider the case of (£, m) = (7, 5). Then we have 

ft= (20,17,14,10,8,4,2). 
Suppose that /x = (19, 17, 14, 11, 8, 5, 1). Now we obtain the following sequences: 

a(£) = (1, 3, 5, 6, 7) - (1, 3, 5, 6, 7) = (0, 0, 0, 0, 0) 
a(/i) = (2,3,4,5,6)- (1,3,5,6,7) = (1,0,-1,-1,-1) 

7 (A) = (7, 5, 3, 2, 1) - (5, 4, 3, 2, 1) = (2, 1, 0, 0, 0) 
7 (m) - (6, 5, 4, 3, 2) - (5, 4, 3, 2, 1) = (1, 1, 1, 1, 1). 

We have 

<5 2 ( M b [l]) ( 5 3 (M) = (-l)© +1 ° = -l. 
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